THE SUMMER INSITIUTE OF LINGUISTICS 
BILINGUALISM ASSESSMENT* 


GENERAL INSTRUCTIONS 
PERSONNEL 


Assessments аге typically conducted Ву a second language (L2) 
TESTER, a LINGUIST, and a mother-tongue (L1) ASSISTANT. The 
LINGUIST must be able to communicate directly with the TESTER 
and the ASSISTANT. L2 refers to the second language of the 
person who is being assessed. This is also referred to as the target 
language ог the assessment language. Ll refers to the first language 
of the person who 15 being assessed. This is also referred to as the 
mother tongue. 


THE TESTER 15 a mother-tongue speaker of the assessment language (L2) 
who is sufficiently familiar with assessment procedures to 
interact with the SUBJECT as stipulated' in each task during 
the test. The TESTER should speak only the (2 to the 
SUBJECT, and it should not be necessary for the TESTER to 
speak to the ASSISTANT. If, however, the TESTER does speak 
to the ASSISTANT, the L2 should be the language used. 


THE LINGUIST is ап assessment specialist fully conversant with the SIL 
Bilingualism Assessment procedure and knowledgable about the 
target language (L2), though not necessarily а speaker of 
that language. During the assessment, it is primarily the 
LINGUIST's responsibility to ensure that an adequate sample 
of the SUBJECT‘s communicative competence is obtained. The 
LINGUIST determines which stimuli to present to the 
SUBJECT, as set forth in the instructions. 


THE ASSISTANT is а mother-tongue speaker of the SUBJECT's first 
language (11). The ASSISTANT's task is to explain the 
purpose and assessment instructions to the SUBJECT in the 
Ы? The ASSISTANT supplies the questions asked by the 
SUBJECT іп Part Two and the information related by the 
SUBJECT in Part Three. The ASSISTANT also provides moral 
support to the SUBJECT and explains what the SUBJECT has 
said in Part Two for the LINGUIST after the assessment. 


Following the assessment, the LINGUIST consults with the TESTER 
and awards the score. Only a LINGUIST certified to administer the SIL 
Bilingualism Assessment may award the score. Some individuals may 
be both TESTERS and certified LINGUISTS. Training is given by SIL to 
ensure uniformity of scoring and adherence to proficiency standards. 


*Adapted from the 1987 Foreign Service Institute Oral Proficiency Test" 


by The Summer Institute of Linguistics and Dr. Thea C. Bruhn, Head, 
Language Testing Unit, Foreign Service Institute, U.S Department of / 
State for use in societies that include pre-literate communities.)  — 


UKAFI LUPY биуауо T 


THE ASSESSMENT FORMAT 
The Assessment consists of three parts: 


1. WARM-UP CONVERSATION: The SUBJECT and the TESTER converse on 
social and personal matters іп the target language. Тһе TESTER 
asks the SUBJECT questions on social and personal topics. 


2. GETTING INFORMATION: The SUBJECT uses the target language to 
interview the TESTER and gather information and opinion, The 
SUBJECT acquires information from the TESTER and explains it in the L1 
to the ASSISTANT. 


2% RELATING INFORMATION: The SUBJECT, using the target language, 
gives information to the TESTER on а topic and responds to 
comments. (The ASSISTANT briefs the SUBJECT on the selected topic in 
the Ll before the SUBJECT begins this part). When the sample is 
complete, the TESTER closes the test. 


The first part, the WARM-UP CONVERSATION, has been included 
because the skills involved are important in both formal and informal 
contexts. 


The second part, GETTING INFORMATION, allows for the display of 
questioning skills and conversational management, as well as а 
demonstration of comprehension accuracy. 


The third part, RELATING INFORMATION, calls upon a wide array of 
skills of expression, including discourse tactics and organizing 
abilities. IN EACH PART, THE TESTER SHOULD ATTEMPT TO RAISE THE 
CONVERSATION TO THE HIGHEST LEVEL THAT CAN 8E SUSTAINED BY THE 
SUBJECT. 


TRAINING 


1. The TESTER and the ASSISTANT are trained by the LINGUIST for 30 
minutes (or more) before the first test. 


2. The first part of the training consists of an explanation of the 
purpose and procedures used for the bilingualism assessment. The 
function of the three different parts of the assessment should be 
explained. The TESTER and the ASSISTANT should be made aware of the 
roles they play in each of the three parts. The TESTER should not 
speak in the Ll during the interaction in order to enhance the 
naturalness of getting and relating information. The ASSISTANT should 


not speak to the SUBJECT in the L2 at anytime during the assessment 
situation. 


3. If possible, the TESTER and ASSISTANT should have a chance to see 
several typical assessments, with SUBJECTs displaying a range of 
bilingual ability. These demonstrations may be either 
video-recorded or live. Demonstrations are especially helpful if the 
LINGUIST, ASSISTANT, or TESTER is Level S-2 or below in the language 
used in training. 
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4. A summary discussion of the purpose and procedures should be 
conducted after the demonstrations. Procedures should be described in 
detail. Skill level descriptions and performance standards need not 
be described. The five factors which influence an assesment may 
be described with representative examples. Comprehension, 
for example, may be restricted to common topics or it may cover а 
wide range of topics; the SUBJECT may or may not be able to follow 
natural speech which has not been artificially adjusted. 


5. Two to five practice sessions (or more) may be needed before 
serious testing can begin. 


LANGUAGE RESEARCH 


1. Before testing begins, an investigation is needed into whether or 
not a standard form of the language exists, and if so, how the 
standard form is characterized or defined, This investigation would 
іпсішде library research, consultation with linguists, determination 
of government policy, and noting radio and television useage.* Іп 
cases where the standard form is not intelligible with some regional 
varieties which are looked upon as dialects, there will probably need 
to be more than one standard variety defined for total coverage. The 
LINGUIST should make an attempt to become as familiar as possible with 
the language and culture of mother-tongue speakers of the L2. 
Cultural and linguistic insights gained in this way will be useful to 
the LINGUIST іп evaluating a SUBJECT's bilingual ability during the 
assessment interaction. 


2. А group of knowledgeable native speakers, perhaps drawn from 
members of the local academic, government, and media sectors, should 
concur that the speech of the people selected as TESTERS reflect the 
standard form of the L2.* 


3. Several samples of speech representing a range of levels should be 
submitted to the above group in consultation with a linguist trained 
in SIL Bilingualism Assessment techniques to achieve a consensus on 
scoring each level. The scores must be functionally equivalent for 
all languages ай any time. These samples on video or audio cassette 
recordings are then archived for that language to establish and 
maintin quality control and prevent scoring drift. 


PRELIMINARY CONSIDERATIONS 


1. VENUE 
A bilingualism assessment can be conducted almost anywhere, 
provided the environment is comfortable and relatively quiet. ALL 
ASSESSMENTS SHOULD BE TKPED.v- 
RECORPED 


* In languages which have long had an established standard, it may be 
that а certain level of education, (e.g., аУВ-А.ф may represent a 
de facto standard. rrr Capi ceg e 


E 
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2. 


SOCIAL 
There may be difficulties when а young TESTER is involved in 


assessing an older SUBJECT. For these reasons it пау be adviseable to 
have both an older and a younger TESTER. 


-Cultural norms of politeness may restrict the TESTER from 
pushing the SUBJECT into conversational levels beyond the 
SUBJECT's comfort zone. END tg 

-The TESTER may not һауе -as—muet control over the interaction. 

-The TESTER may differentiate between the speech of an older 
person and that of other age groups. Whether this is cultural 
or simply the limit of the person's ability may not be clear, 
and the TESTER may be unwilling to "criticize" the SUBJECT's 
speech. 


Female TESTERs may have difficulty in initiating interaction with 


male SUBJECTS and female SUBJECTs may have similar difficulties in 
responding to a male TESTER due to shyness and/or the cultural norms 
of male/female relations. For these reasons it may be adviseable to 
have both a male and female TESTER. 


the 


als 


Topics should be chosen in consultation with sensitivity to both 
SUBJECT's and the TESTER's culture. 


TECHNICAL А 
-Check the equipment апа have it all ready to go das Hi SHAM Tat 
-Keep the microphone close to the SUBJECT. 

-Usp pne side, ofa 9р ELENA tape for a SUBJECT se Gee kees 

PROCEDURAL Фе 

-The TESTER should explain to the SUBJECTAthat it may be necessary x 
to interrupt the conversation. They 222-5 Cee алса ptm Ee unu беге 

-It will be necessary for the LINGUIST to signal the TESTER when "7v 
an adequate speech sample has been obtained. If the the sample 
obtained has not demonstrated the limits to the SUBJECT's 
communicative competence, then the LINGUIST will also need to 
signal the TESTER to continue with that section of the 
assessment. Such signals should be agreed upon beforehand. 

-Record all instructions from the LINGUIST and the ASSISTANT to 
the SUBJECT. Record the SUBJECT's consent to have the interview 
taped. 

-The LINGUIST should maintain control of test situation. Be aware 
of interruption opportunities (pause, change of posture, etc.) 

-Тһе LINGUIST may need to take advantage of his/her position as an 
outsider to stay in control of the assessment situation, 

-The LINGUIST should decide what personal information about each 
SUBJECT it is necessary to collect. The scoring form allows for 
the questions most commonly used on sociolinguistic surveys. It 
is recommended that the LINGUIST collect this information before 
the assessment begins. 


u 
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PART ONE: WARM-UP CONVERSATION 
2 PURPOSE 
This first task has two objectives: 
-To get the assessment off to a comfortable start. 


-To assess how adept the SUBJECT jis at sustaining a routine 
social conversation. Of special interest are the SUBJECT's 
abilities to initiate and respond smoothly, to select culturally 
appropriate comments and reactions, and to establish rapport 
with the TESTER. 


PROCEDURES 


1. The LINGUIST ensures that the TESTER is prepared to pursue one of 
the suggested conversational topics. (The LINGUIST records the 
topic selected on the scoring form.) 


2. The TESTER starts the conversation by greeting the SUBJECT, 
exchanging pleasantries, and asking questions. The TESTER should NOT 
interrogate the SUBJECT, but should pursue the topic based on what 
the SUBJECT says. The points mentioned under each conversational 
topic are to guide, but not restrict, the flow of conversation. The 
SUBJECT should be encouraged to take the initiative as 
appropriate іп normal conversation, rather than simply answer 
questions. 


3. When the LINGUIST determines that an adequate sample of the 
SUBJECT's conversational abilities has been obtained, he/she 
signals to the TESTER to conclude the conversation. The WARM-UP 
CONVERSATION should last a MINIMUM of five minutes and should 
continue for as long as the LINGUIST feels is necessary. 


55 The LINGUIST has the option of ending the assessment with the 
WARM-UP, BUT ONLY IF the SUBJECT's performance has been 50 poor 
throughout the conversation (an 5-0 level) that no purpose would 
be served by attempting the rest of the assessment. It is 
the LINGUIST's responsibility, therefore, to ensure that the 
SUBJECT's difficulties are NOT a result of assessment anxiety to any 
significant degree. 
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WARM-UP CONVERSATION: Suggested Topics 


1. DAILY LIFE ы 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Ask the subject to tell you a little about him/herself: for 
example where he/she is from, where he/she has worked or travelled. 
Find out how the places of his/her travel compare to his/her 
hometown. Ask how events in daily life compare or contrast between 
the two places. Inquire after ап incident that he/she remembers 
which particularly illustrates the comparison or contrast between 
the two places. Follow up on whatever answers the subject provides 
if it seems necessary to get him/her talking more. 


2. OCCUPATION 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out where he/she works and what sort of work he/she does. 
Find out what this subject's very first job was; how he/she found the 
job, how much he/she earned, what he/she had to do, what the standards 
of the performance were, how he/she felt about the job. AND/OR Find 
out what job the subject had prior to his/her present job and the 
details about it. Follow up on whatever answers the subject gives if 
it seems necessary to get him/her talking more, 


3. HOMETOWN 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out where he/she is from, where this place is located in 
relation to other places in the general area, what the terrain is 
like, what the climate is like, how the climate there compares to the 
climate here, for instance, what the weather is like here today and 
what it probably is like there today, how people in that area shelter 
themselves from the elements. Follow up on whatever answers the 
subject gives if it seems necessary to get him/her to talk more. 


4. CHILDREN 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Ask the subject to tell you how many children he/she has and a 
little bit about them. If the children are mostly adults now with 
families of their own, ask where they are living and what they аге 
doing. Find out if they are still following the traditional way of 
life or if they have left the traditional ways and what the subject 
thinks about this. If the children are mostly still young, ask about 
the different characteristics of each child. Find out if any of them 
have been sick very often and what they subject does to prevent the 
Sicknesses. Find out how children learn about what is dangerous or 
the other things children need to know. Ask about the 
responsibilities children have, Follow up on whatever answers the 
subject provides if it seems necessary to get him/her talking more. 
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5. FAMILY 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Ask after the subject's family members, where culturally 
appropriate, ask how many sisters, brothers, wives, children, etc., 
the subject has and whether his/her parents are living. Where аге 
they living and what are their occupations. How has family life 
changed in the village over the past 10 years. Follow up on whatever 
answers the subject provides if it seems necessary to get him/her 
talking more. 


6. WORK 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Follow the greetings with questions about the subject's work. 
If he/she is a farmer, the topic may naturally move to crops, weather, 
harvests and market prices. If he/she has a different occupation, 
particularly one requiring certain qualifications, ask why he/she 
chose this type of work and what kind of training was necessary for 
Tt. If the subject has had other jobs before his/her present one, 
pursue these in the conversation. If it is culturally appropriate, 
ask how much the subject earns. Follow up оп whatever answers the 
subject provides if it seems necessary to get him/her talking more. 


7. RESIDENCE 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Determine whether the subject is originally from the test site 
and how long he/she has lived there. Ask whether or not the person's 
family also lives there. If the subject has lived in other villages, 
or in а large city, ask him/her to compare life in the different 
places and to give reasons why опе might prefer one to the other. 
Initiate discussion of people, places or customs. Find out if 
he/she has ever thought about living in another country, which one, 
and why. Follow up on whatever answers the subject provides if it 
seems necessary to get him/her talking more. 


8. WEATHER 


Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Comment about present weather conditions and how they compare 
with those experienced at the same time last year, Ask how long the 
weather has been like this and how it is affecting village life in 
terms of the growth of crops, care of livestock, and the general 
health of the people. If relevant, make a comparison to the climate in 
another area оғ ask the subject to contrast it with that of another 
place he/she has lived in. Follow up on whatever answers the subject 
provides if it seems necessary to get him/her talking more. 


9. ILLNESS 
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Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out a little about the subject's family and whether or not 
all are in good health. If someone in the family is currently 111, 
then find out what kind of sickness he/she has and what is commonly 
done to cure it. Find out why the subject thinks such illnesses 
occur. Ask if there are alternate ways of curing such an illness and 
what the subject thinks about the relative merits of each of these 
methods. If no one in the family is currently ill, then inquire about 
past sicknesses and follow up with similar sorts of questions as for a 
current illness. Follow up on whatever answers the subject provides 
if it seems necessary to get him/her talking more. 


10. CLOTHES 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Remark on commonly noticed types of clothing, jewelry, cosmetics, 
and/or appearance as appropriate. Find out about distinctive ways 
of wearing, making, or otherwise acquiring such clothes, cosmetics, or 
jewelry. Find out how this is different from the clothes, jewelry, or 
cosmetics of neighboring groups and what the subject thinks about 
neighboring groups' habits іп this regard. Follow up on whatever 
answers the subject provides if it seems necessary to get him/her 
talking more. 


11. COSTS 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out where the subject works and what sort of work he/she 
does. If it is agricultural work, ask about the weather and current 
crop and find out what the subject's expectations are for the current 
crop. Find out the price at which he/she hopes to sell the crop when 
it is harvested and what factors will influence whether or not he/she 
gets a good price. If the subject is a herder or a hunter/gatherer, 
then ask the properly corresponding sorts of questions. If the 
subject is not а producer of raw materials, or not integrated into a 
cash economy then pick a different topic. Follow up on whatever 
answers the subject provides if it seems necessary to get him/her 
talking more. 


12. CELEBRATION/HOLIDAY 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Have in mind a recent holiday and ask the subject what was done 
for that holiday. Find out if the people stayed at home or traveled 
and if 50, where. Ask the subject to describe the reason for the 
holiday and why it began as a holiday. Find out in some depth about 
details of what happened during the celebration following up on 
information volunteered by the subject. Ask if people in the village 
have any local celebrations and what they are like. Ask who likes 
holidays more, children or adults; men or women. Follow up on 
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whatever answers the subject provides if it seems necessary to 
get him/her talking more. 


13. RECENT ACTIVITEES 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Begin by asking what sorts of things the subject has done 
recently. Has he/she been to town, gone hunting or fishing, been 
repairing some equipment, taking care of sick children, etc. Ask for 
opinions or evaluations of these recent happenings, why it happened, 
how it was done, the value of the happening. Follow up on whatever 
answers the subject provides if it seems necessary to get him/her 
talking more. 


14. MEDICINE 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Ask what а person does in the village when someone gets sick. 
Find out who the nearest doctor or nurse is and where they сап be 
found. Ask about the kinds of sicknesses they can treat and the kinds 
they are not able to treat. Inquire about the most commonly needed 
drugs, whether they are easily available, and what they cost. Find 
out what life was like before these drugs and doctors were available 
and what improvements are most needed now. Follow up on whatever 
answers the subject provides if it seems necessary to get him/her 
talking more. 


15. FOOD/CROPS/HARVEST 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out if the subject or people іп the village/town are 
involved in growing a crop, what it is, whether it is one of their 
main foods, what farmers do to take care of this crop, and what other 
crops are grown. Ask about when they plant and harvest. Find out 
is the land is good, what the terrain and soil are like, and how the 
land could be improved. Inquire about water for farming. Find out if 
it is sufficient, if there is а lot of rain, if there is 
irrigation. Ask if there are orchards, what kind, and how people 
care for them. Follow up on whatever answers the subject provides if 
it seems necessary to get him/her talking more. 


16. PASTORAL SOCIETIES 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out if the subject or people іп the village/town are 
involved in raising animals, what kind they raise, and what products 
they obtain from the animals. If they have herds, ask about how they 
find grass for them, and whether they have to move around to find 
water and grass. Inquire about other subsistence activities, like 
growing crops, or fishing. Follow up on whatever answers the subject 
provides if it seems necessary to get him/her talking more. 
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17. EXCITING/DANGEROUS EVENTS 
Greet the subject and exchange introductions and routine 
pleasantries as necessary and appropriate. 


Find out if there was ever a time when the subject was in danger 
and ask what happened. Have him/her tell about any encounter with a 
wild animal. If such a thing never happened to the subject, perhaps 
he can relate such an event that happened to a close friend or 
relative. Follow up on whatever answers the subject provides if it 
seems necessary to get him/her talking more. 
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PART TWO: GETTING INFORMATION 
PURPOSE 


The SUBJECT is given the task of questioning the TESTER on some topic. 
The object is to obtain information - both facts and opinion - from 
the TESTER, and then to report in the 11 on the information obtained, 
The task is іп large part опе of accurate comprehension, but the 
SUBJECT must also ask good questions, keep the interaction on track, 
follow up on incomplete answers, pursue the significant points, and 
clarify issues. 


PROCEDURES 


1. The LINGUIST instructs the ASSISTANT, giving him an appropriate 
topic along with suggested questions. The domain of the topic 
selected should be different from that chosen for the WARM-UP 
CONVERSATION. The ASSISTANT relays the information to the SUBJECT 
who then begins the interview with an opening question. (The 
LINGUIST records the topic selected on the scoring form.) 


2. The TESTER responds with his/her views in the L2, speaking 
naturally, providing both detailed information апа thoughtful 
opinions. IT IS IMPORTANT THAT THE TESTER USE A NORMAL RATE OF SPEECH 
AND А STYLE THAT WOULD BE USED WITH ANOTHER NATIVE SPEAKER, It is up 
to the SUBJECT to slow the TESTER down or ask for clarification or 
repetition. 


3. As the TESTER answers these questions, the SUBJECT reports in the 
Ll to the ASSISTANT. Reports should be frequent enough that the 
SUBJECT does not forget the information. If the SUBJECT's reports are 
not detailed enough, the ASSISTANT is to ask for more details and/or 
more frequent reports in the Ll. The ASSISTANT is also free to prompt 
the SUBJECT with suggested questions as necessary. Тһе ASSISTANT may 
take notes on what the SUBJECT reports. This part of the procedure is 
not a translation, but simply a retelling of the ideas and facts 
learned from the TESTER. 


4. It is up to the SUBJECT to stop the TESTER and provide a report in 
the LI of what is said. It may be necessary for the ASSISTANT to 
remind the SUBJECT to provide the report. 


5. When the topic has been adequately explored (a MINIMUM of five 
minutes), the LINGUIST Signals the ASSISTANT to have the SUBJECT 
conclude the interaction. 


6. At the conclusion of the assessment, (i.e., after Part Three) the 
LINGUIST should discuss the content of the SUBJECT's report to the 
ASSISTANT in order to evaluate the SUBJECT's comprehension. The 
GETTING INFORMATION section assesses the ability of the SUBJECT to 
ELICIT AND  COMPREHEND detailed opinion and factual information from a 
speaker of the 12, 
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PART TW0: Suggested Topics 


1. LIFE IN THE CITY 

Does the tester live іп the city? How would someone find a 
good place to live there? Where do you go to get food? What kind of 
jobs are available for people like me? 


How is life in the city different from life here? Does living 
in the city cause family problems? How are these problems solved? 
Which way of life do you prefer and why? 


What do people in the city do for entertainment? What sort of 
cultural activities do people participate in? What do people do at 
these events? Can you tell me about a cultural event that you 
particularly enjoyed? 


2. CHANGE OF RESIDENCE 

Where does the tester live and how long has he/she been there? 
Has he/she lived anywhere else and if so, where? What were the 
circumstances that precipitated the move? Which location does 
he/she prefer and why? 


How are the people different in the tester's current place of 
residence from his old place of residence? Do the people eat 
different food, dress differently, or look different? What 
adjustments has the tester had to make in his daily habits because of 
the move? 


If the move involved a change from village to city, what are some of 
the differences in the areas of family life, cultural activities, pace 
of life, primary values, religious practice? 


3. OCCUPATION 

What is the tester's present occupation? Ном did he/she come to 
have that particular job? What aspects of his/her work does he/she 
particularly enjoy? Why? What are some aspects that he does not find 
enjoyable? Why? 


What are the responsibilities and daily tasks оп the job? Ном are 
relationships with co-workers? If he/she could choose another type of 
work what would it be? 


Does the tester find his job fulfilling or challenging? What aspects 
of the job are most satisfying? Are there ways in which the sort of 
work the tester does could be made easier? What kind of person is 
needed to do the tester's job? 


4. TRANSPORTATION 

What are the major means of transport in the region for moving 
both people and products? Where do the most commonly used routes go? 
How does one take a bus or train? How much does it cost? If the bus 
or train does not normally stop where a person wants to get off, how 
can one get the vehicle to stop? 
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Has the tester personally had апу unpleasant experiences such as 
involvement іп an accident, breakdown while travelling? What happened 
and how was the situation fixed? Has the tester ever seen a road 
accident? What happened to the people involved? 


What is transportation like in other places? What are the advantages 
or disadvantages of the various available means of transport, 
including speed, range and relative cost? How does the tester think 
it could be improved? How has transportation іп the region changed 
over the past twenty-five years? 


5. EDUCATION 

Has the tester been to school? To university? How many years has 
he/she studied? What topics or subjects did he/she like to study 
best? Why? What subject did he/she get the highest marks in? In what 
subject did he/she get the lowest marks? Why did he/she get those 
marks in those subject? 


Why аге some teachers better than others? Сап the tester recall 
one teacher who мас particularly good? Mhy is he/she remembered? 
What language did the tester first learn in school? What other 
languages? Would the tester go to school or go back to school if 
he/she had the chance? 


What subjects are studied іп the university? What sorts of 
things are studied in these subjects? Ask the tester about the most 
difficult exam he/she had to take? Why was it so hard? 


6. EXCITING MOMENTS 

What is the most exciting thing ever to have happened to the 
tester? Why was it so exciting? Would he/she ever want to repeat the 
experience? Why or why not? What would he/she do differently if 
he/she were able to repeat the experience? Were there other people 
with him/her at the time and what did they think of it all? If 
someone wanted to try (or avoid) such an experience what should they 
do? 


7. DEATH-DEFYING MOMENTS 

Have the tester ever been afraid for his/her life? What happened 
that caused him/her to be afraid? How did he/she escape from the 
threat to his/her life? Was anyone else with him/her at the time and 
how did he/she escape? What would he/she do differently if the same 
thing happened again? How does someone avoid getting into such 
situations? 


8. FOODS 

What sort of foods does the tester eat? Does he/she eat anything 
that we do not eat here? What are the relative merits of the 
different kinds of food that people eat? 


Has the tester ever eaten European food? What did he/she think of it? 


How does the food preparation differ from what the tester is familiar 
with? 
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What foods are the healthiest and make people strong? What sort of 
foods should be avoided and why? What sort of foods cause illness? 
What sort of people should should avoid which kinds of foods? 


9. MUSIC 

What kind of musical instruments does the tester have or play? How 
long did has he been playing the instrument? Why did he/she choose 
that instrument? What other instruments would he/she like to play and 
why? 


Does the tester have music that is different from the kind that 
we have here? What is different about it? Is there special music for 
special reasons and what are they? 


What kind of people play music and why? Which is better, the 
traditional music or the new music and why? Is traditional music dying 
out and what can be done to rescue it? 


10. POLITICAL OR LEGAL SYSTEMS 

How does а person get elected or appointed to be a judge (or 
representative, or minister, or village official)? 15 it necessary to 
"know" someone important? How much training do these people have? Do 
you know anyone who has a job like this? Are political appointees 
better than elected officials? Why? 


11. HISTORY 

What has the tester's grandparents or parents told him/her about 
life when they were young? What are the differences in the way they 
lived and life now? Were people wealthier or poorer at that time? 
Were customs different and if so, how? 


Were morals different then than now? How was the religion different? 
Were his/her people always in this place? Where did they come from? 
Why? What was the journey like? 


Was transportation, water supply, farming, city life different опе 
hundred years agor? How did people get news then? What did people 
think about other people іп other cultures at that time? 


12. CELEBRATIONS 

Has the tester recently been in any celebrations? What happened? 
What was it for? Where did it take place? Who did he/she go with? 
How long did it go on? Who was in charge? What kind of people came 
to the celebration? What is his/her favorite celebration each year? 
Why does he/she Тіке it? 


Is the tester planning a celebration soon? How will it differ 
from others he/she has had? How will he/she decide who to invite to 
the celebration? What will happen if someone comes who is not wanted? 


What are marriage celebrations like? What are the different parts of 
the wedding ceremony. What customs must be observed? Is there а 
coming of age celebration? How old are people when they have this 
celebration? What rituals are involved? 
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13. ENTERTAINMENT 

What does the tester like to do іп his/her spare time? Does 
he/she ever go to the movies, plays, musical events, or parties? What 
was one that he/she liked best? Why did he/she tike it? Can the 
tester describe a recent event he/she attended. 
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PART THREE: RELATING INFORMATION 
PURPOSE 


The SUBJECT is given the task of presenting information to the TESTER 
on some topic. The object is to convey information - both facts and 
opinion - to the TESTER. The task is in large part one of accurate 
production and cohesive presentation, but the SUBJECT must also 
respond to апу questions the TESTER might have about portions of the 
information so conveyed, 


PROCEDURES FOR RELATING INFORMATION 


I The LINGUIST, іп consultation with the TESTER, chooses ап 
appropriate topic for the SUBJECT to talk about. The domain of the 
topic selected should be different from those chosen in the WARM-UP 
CONVERSATION and GETTING INFORMATION. (The LINGUIST records which 
topic was selected on the scoring form.) 


2. The LINGUIST gives the ASSISTANT a background paper or outline. 
If the ASSISTANT does not read, һе may listen to a short cassette or 
be briefed orally by the LINGUIST. The content of the briefing 
should be of interest to the SUBJECT, but not such as to provoke an 
emotional reaction. 


dz The ASSISTANT relays this information to the SUBJECT in the Ll. 
The SUBJECT discusses what he/she will say with the ASSISTANT for 
about five minutes. 


4. The SUBJECT then conveys this information in the L2 to the 
TESTER, who listens attentively. The TESTER may raise points of 
information or clarification as necessary. 


5. When the SUBJECT has finished relating the information, the 
ASSISTANT may encourage him/her with further ideas on the same topic 
and the TESTER may ask follow-up questions to which the SUBJECT 
responds, 


6. When the topic has been adequately explored, the LINGUIST signals 
the TESTER to conclude the discussion. The LINGUIST decides whether 
or not an adequate sample of speech has been obtained; if so, then the 
TESTER may conclude the topic. 


7. If the chosen topic has been exhausted, and this procedure has not 
yet reached the limits of the SUBJECT's L2 ability, then a new topic 
may be chosen which will provide a better chance of obtaining ап 
adequate speech sample. Іп this case the ASSISTANT and the SUBJECT 
will have another five minutes to discuss the new topic before the 
third part begins, if such is necessary. 


NOTES TO THE LINGUIST 


1. 1% is the SUBJECT who does most of the talking and who carries the 
major responsibility for the success of this task. He/she is aided by 
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the ASSISTANT who provides ideas and prompts іп the Ll when the 
SUBJECT cannot think of anything new to say. 


2. The TESTER must be an active listener throughout this portion of 
the procedures. She/He must listen carefully to what the SUBJECT is 
saying and not let his/her attention wander. 


3. Тһе TESTER may interrupt the SUBJECT during his/her discussion if 
he/she needs clarification, if something is confusing, or if he/she 
wants to follow up on a point the SUBJECT is making. 


Here are some things the TESTER might say to help draw the SUBJECT 
out. The objective of the TESTER in this part of the procedure is to 
elicit from the SUBJECT a clear and explicit sample of speech to be 


rated, a. "Could you clarify that a little bit?" b. "Why do 
you think that?" с. "What other things might be true to say about 
this?" d. Give an idea that, though possible, might not work very 


well. See if you can draw the SUBJECT into а discussion about 
the relative merits of the two ideas. For instance, if talking 
about a pocket knife, suggest that it might be possible to skin a 
large animal with such a knife and discuss the proper tools that that 
job might need. e. If you were able to change what had already 
been done, what would you like to do? 
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PART THREE: Suggested Topics 


1. TECHNOLOGY 

Explain what a tape recorder is, what it is used for and how to 
record and play. Explain that the sound goes in the microphone and 
that the tape recorder records the sound on the tape and the tape 
remembers what is on it. Explain that when the machine plays the 
cassette, it reads the tape and makes the sound according to what is 
written there. 


Explain that the microphone changes the sound into electricity, 
which the cassette remembers by the way that the recorder organises 
small pieces of metal in the tape. When the cassette plays, the tape 
recorder uses а magnet to modify electricity according to the pattern 
that is оп the tape. The speaker then changes that electricity into 
sounds. 


2. EDUCATION 

Explain that it is good to have an education because it helps to 
get a job and earn money. Or explain problems sometimes caused 
by education, i.e., children who go to school do not respect their 
parents any more and do not live according to the traditional way of 
doing things. Or explain that while education might be good for some 
children, other children are needed to work with their parents and so 
cannot be spared for school. 


Explain the school system and how much it costs to send a child 
to school. Explain how you were able (or not able) to go to school. 
Explain the sorts of things they teach in school and why they are (or 
are not) important. Explain what a student must do to get into school 
and university and how the two are similar and different. Explain why 
some children do better in school than others. 


3. CULTURE 

Explain how the way you live is different from the way that 
neighboring peoples Jive and why your way is better (or worse) than 
other ways of living. Choose a particular culture foreign to your own 
and describe it іп regards to people's values, manner of dress and 
food preparation, and familial relationships. 


4. DEBT AND CREDIT 

Explain how debts and credit work in another place. Explain how 
people borrow money by obtaining a piece of plastic from a bank. Тһе 
piece of plastic is worth a set amount of money and you can take this 
plastic card to a merchant and he will sell you goods worth the amount 
that you borrowed from the bank. Тһе merchant will then get the money 
that you borrowed directly from the bank and you will never see it. 
The bank will add опе (and a half) percent of the amount you owe to 
your debt every month until you pay it off. 


5. SUPPLY AND DEMAND 

Explain how the price of a local crop is low just after a harvest 
but that it is expensive six months later. Explain that this is 
because when everyone wants to sell the same thing, a person who wants 
to buy is able to bargain better and so get a cheaper price. But when 
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everyone has sold all of the crop and only one person has the crop to 
sell, then he can sell it for a high price because everyone will want 
to buy it. When everyone wants to buy something, then the seller can 
bargain better. 


7. LEGAL INSTITUTIONS 

Explain what happens if a thief gets caught. Describe a recent 
case where this has happened. Talk about the different kinds of 
things that thieves steal. If there are different punishments for 
different crimes, describe the appropriate punishment for various 
crimes. If there is more or less crime than in previous times, then 
explain why. 


8. WORLD EVENTS 
Describe the activities of the country's president оғ other 
well-known national figures. 


Discuss strengths and weaknesses of national sports teams or of a 
specific match that the assistant attended. 


Discuss any specific disasters that may have happened recently 
(i.e., plane crashes, earthquakes, shocking world events, etc.) 


9. MEDICINE 
Describe a new vaccine that will be available soon for Hepatitis 
B. There are two kinds of Hepatitis, Type А and Type В. Туре B is 


the most dangerous. Up until now, almost no one has been able to 
afford vaccine for Туре B because it costs about $150 US which is 
equal to about in our currency. But the new vaccine is man-made 


instead of from the natural products that cost so much. Therefore 
there is a good likelihood that the price will come down and become 
affordable after several years of development. If that happens, maybe 
Hepatitis B, like smallpox, can be wiped out permanently. 


10. OTHER CULTURES 

Describe the different clothes men wear for working апа for 
dressing up in another culture; do the same for women. Explain when 
people would choose to wear different kinds of clothes. Explain how 
there are special clothes to wear for special purposes, i.e., sports, 
religion, certain jobs, etc. Explain the attitudes that clothes 
demonstrate апа how what you think of yourself changes depending on 
what you might wear. 


Alternatively, describe an event from an unfamiliar culture. 
Suggestions can include weddings, funerals, or coming of age 
ceremonies, Christmas, Easter, Thanksgiving. Explain the meanings, or 
beliefs behind certain activities included in the event. 


11. TRAVEL 

Describe a recent trip the ASSISTANT or LINGUIST took, telling 
where they went, Where they started from, where they went along the 
way, and where they ended up. Describe who travelled with them and 
why; also how they traveled and how long it took. Describe the 
luggage with which it was necessary to travel. Tell about interesting 
things that happened along the way and details of what they saw. 
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Describe any fears about the trip or about what might happen when they 
arrived. 


Alternatively, decribe a type of transportation unfamiliar to the 
subject (e.g., airplane). 


Alternatively, describe the steps necessary for traveling by bus, 
train, or plane, etc. 


11. HOUSING 

Describe the different kinds of shelter that people use, telling 
how and why are they different and how many people live in а typical 
house. Describe the materials of which the houses are made, the 
people who build them and the process of gathering or buying the 
materials. Describe the constuction process. 


Alternatively, describe urban housing in the same terms. 


12. POLITICAL SYSTEMS 

Describe the polical system of an entity unfamiliar to the 
subject. Describe how it worksand its main features. Tell about how 
the system developed and who can participate in it. 


13. HISTORY 

Describe an unfamiliar episode or hero from history or 
legend (i.e., а war, the reign of a king or important leader, the 
change of political boundaries, historic disasters, etc.) 
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SCORING THE ASSESSMENT 


1. ASSIGNING THE CHECKMARKS TO THE SCORING GRID 


The first step in scoring the test is to match the SUBJECT's 
performance with the "performance standards" in the scoring grid. For 
each of the five factors, find the cell containing the description 
which best exemplifies the overall performance on that factor. Put a 
checkmark in that cell. 


If you cannot decide on the basis of the abbreviated descriptions 
in the scoring grid, refer to the full descriptions of the 
"Performance Standards" section. You should be able to find a 


description that fits what you have heard the SUBJECT do during the 
test. 


24 GETTING THE RAW SCORE 

Compare the checkmarks you have made on the scoring grid with the 
Raw Score Table. Select the specific numbers from within the boxes 
that you have checked and write them down. There should be five 
numbers in all, one for each performance factor. 


The total of the five numbers is the RAM SCORE. 


3s FINDING THE S-SCORE 

Locate the Raw Score you have obtained on the S-Score table. 
It shows the corresponding S-Score. Refer to the Skill Level 
Descriptions to verify that the description for the S-Score 
indicated fits the sample. 


4. SCORE VERIFICATION 

Read the Skill Level Description for the S-Score designated by the 
Raw Score. Then read the Skill Level Description for the S-Score 
immediately above and below the designated S-Score. Verify that the 
designated S-Score is indeed the most accurate description of the 
SUBJECT's bilingual proficiency. 


If опе of the alternate Skill Level Descriptions better describes 
the SUBJECT's proficiency, review the tape and re-assign the 
checkmarks on the scoring grid for more accurate performance standards 
(see Step One, above). Then re-calculate the Raw Score. 


If you are convinced that the original assignment of performance 
standards was accurate, then adjust the numbers assigned in each of 
the boxes for the performance standards and re-calculate the Raw Score 
(see Step Two, above.) 
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FIVE FACTORS THAT INFLUENCE BILINGUALISM ASSESSMENT 


1. COMPREHENSION evaluates how well the subject understands what is 
said іп the L2. As understood by the assessment technique, 
comprehension is interactive, that is, it includes the social meaning 
and implications of the speech act as well as the meaning of the 
spoken words. 


2. DISCOURSE COMPETENCE evaluates speech above the sentence level. As 
understood by the assessment technique, discourse competence includes 
how the subject organizes his/her speech and copes with the demands of 
face-to-face interaction in making his/her meaning clear. This is 
exemplified by how well the subject manages turn-taking, the 
cohesiveness of the information presented, transitions between 
thoughts, etc. 


3. STRUCTURAL PRECISION evaluates the use of the non-discretionary 
rule-governed aspects of the syntactical, morphological, and 
phonological systems of the language. As understood by the assessment 
technique, structural precision includes evaluating how accurately and 
appropriately the subject controls and encodes messages in the L2. 


4. LEXICALIZATION evaluates the breadth and appropriateness of the 
lexicon available to the subject. As understood by the assessment 
technique, lexicalization includes how well the subject uses the 
connotative and denotative meanings of words, idioms, metaphors, 
synonyms and their near-equivalents, etc. 


5. FLUENCY evaluates the continuity and quantity of the speech 
produced by the subject. As understood by the assessment technique, 
fluency includes the ability to produce speech without effort in the 
appropriate quantity and degree of smoothness according to the context 
of the speech act. 
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DESCRIPTION OF THE 5 FACTORS AT EACH PERFORMANCE STANDARD 
COMPREHENSION (INTERACTIVE) 


1. BLOCKING - MISUNDERSTANDINGS OF VERY SIMPLE LANGUAGE. The 
subject may understand fragments of ongoing speech which is 
simplified (i.e., relies оп very high-frequency lexicon and 
structure) and artificially slowed, The subject may not recognize 
that he/she has misunderstood, responding in an incorrect, 
inappropriate, or unrelated manner. Even with repetition and 
clarification, the subject cannot understand enough to maintain 
ап interaction even on common topics on which the tester and subject 
share knowledge. 


2. DYSFUNCTIONAL - SUBJECT RECOGNIZES NON-UNDERSTANDINGS, WHICH ARE 
QUITE FREQUENT, but may not exhibit comprehension even after 
repetition or clarification, Comprehension is generally restricted to 
common topics on which subject and tester share knowledge. The native 
speaker must adjust the speed and complexity of speech in order to be 
understood, If the target language has a close genetic relationship 
with the subject's mother tongue, or if the subject's mother tongue 
has borrowed much of its lexicon from the target language (as is the 
case with some creoles), then comprehension may appear to be quite 
precocious, but this is not supported by evidence of comprehension of 
non-shared aspects of the language. 


3; INTRUSIVE - DIFFICULTIES IN COMPREHENSION SLOW DOWN THE 
INTERACTION. The subject exhibits understanding after clarifications, 
paraphrase, repetition, or some simplification. Range of contexts in 
which the subject exhibits understanding may be wide. Speed of speech 
may need to be adjusted by the tester. 


4. ACCEPTABLE - EXHIBITS UNDERSTANDING QUICKLY WHEN CLARIFICATION, 
REPETITION, OR PARAPHRASE IS GIVEN. The subject follows natural speech 
which has not been artificially adjusted іп speed, lexicon, or 
structure. The subject catches own non-understandings, which are 
relatively infrequent. Range of comprehension is quite wide, and 
depends very little on similarities between the target language and 
the mother tongue. Comprehension, nevertheless, may be obviously 
greater in those areas in which the subject and the tester share a 
common real-world referential knowledge which is derived from or 
dependent upon the tester's familiarity with, or even membership in 
the subject's culture, rather than vice versa. 


5. SUCCESSFUL - UNDERSTANDING IS LIMITED ONLY BY CULTURAL BACKGROUND 
or lack of some "Shared assumptions" with target language speakers. 
That is, there are examples of the denotative or referential meaning 
being understood, without the implications. Few errors of 
comprehension over the range of tested material. Idioms and 
metaphors, however, may not be comprehended without explanation. The 
converse of this, і.е., when there is good understanding of cultural 
reference, but the subject is limited in his ability to understand a 
wide sample of general language, should not be rated "successful". 
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6. SUPERIOR - UNDERSTANDING IS ESSENTIALLY COMPLETE in the context of 
face-to-face interaction. The subject's understanding of the 
underlying cultural assumptions and/or frame of reference of the 
target language is such that he/she can draw appropriate inferences 
from the tester in most circumstances. 
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DISCOURSE COMPETENCE 


1. BLOCKING - UNABLE TO PRODUCE CONTINUOUS DISCOURSE. Utterances are 
largely stock phrases or learned routines. Sentences may be 
fragmented when that is inappropriate. Essentially no cohesion within 
and/or transition between utterances. Turn-taking behavior is highly 
unnatural. 


2. DYSFUNCTIONAL - MINIMALLY ELABORATE PERFORMANCE on language-use 
tasks. Utterances are largely discrete and ill fit with each other 
and with the gist of the interaction, but individual utterances may be 
well formed, and some routines such as greeting sequences and simple 
pleasantries seem quite natural. Nevertheless, the subject is a very 
unequal partner іп the conversation. Turn-taking is usually stilted 
and unnatural. The tester must draw out the passive speaker and 
frequently ask for elaboration from the subject who cannot develop 
ideas clearly and cohesively in extended production activities. 
Involvement with the topic and/or substance in the presentation is 
very obviously lacking. 


3. INTRUSIVE - PERFORMANCE SHOWS LACK OF COHESION. Range of discourse 
devices (e.g. conversational Management devices, markers, and 
referentials) is limited. The tester must concentrate and interpret 
to follow the subject's line of thought. Nevertheless, the subject 
can respond to the tester's questions, comments, and observations, 
getting main points across, though with a distinctly repetitive or 
ay rere repertoire of functional devices. Turn-taking behavior may be 
good. 


4. ACCEPTABLE - DISCOURSE IS COHESIVE. Discussion can be maintained 
comfortably by both parties. Turn-taking behavior is generally quite 
natural. The subject's use of function markers is appropriate and 
non-repetitive. The SUBSTANCE of longer presentations and/or 
discussions becomes more noticeable than the form, The subject 
exhibits involvement with the topic of the interview. The subject may 
make his point with development, support, transitions, etc. 
Nevertheless, flexibility is somewhat limited. There may be some 
errors in cohesion devices such as personal, spatial, and temporal 
references (deixis). Ellipsis, sentence fragments, and sophisticated 
discourse devices, such as complex modification or embedding may be 
largely absent or rudimentary. 


5. SUCCESSFUL - DISCOURSE IS WELL ORGANIZED. Relationships among 
ideas are clearly marked with a moderately wide range of appropriately 
used discourse devices, such as synonyms, co-reference, complex 
modification, and varied syntactic patterns. Development of ideas is 
clear and marked; transition between ideas, conclusions, parenthetic 
observations, etc. are appropriately indicated, for example, by 
intonation, controlled speed change, the target language equivalent of 
rhetorical devices, etc. Communication is largely independent and 
assertive, but palpably non-native. 
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6. SUPERIOR - BROAD FLEXIBLE CONTROL OF FUNCTIONAL RHETORICAL SPEECH 
DEVICES. The range is similar to that available to the articulate 
well-informed native speaker. The subject communicates assertively, 
when appropriate, and can take and hold the floor, open and close 
discussion and control the discourse to bring about his/her own 
desired outcomes (e.g. the inference might be drawn that the subject 
is quite competent at suasion). Uses the language to convey 
attitudinal as well as referential information to the tester. 
Reliably puts his/her explicit (and usually also implicit) 
communicative intent into the target language. 


Р 
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STRUCTURAL PRECISION 


T BLOCKING - STRUCTURAL ACCURACY 15 LARGELY RANDOM, and/or 
phonological structure is so unusual that the tester for the majority 
of the performance is confused as to the subject's intended message. 
The vast preponderance of utterances beyond memorized, high-frequency 
routines contain such inaccuracies of usage {morphological, syntactic, 
or phonological) that communication is largely telegraphic. 


2. DYSFUNCTIONAL -  MISCOMMUNICATION ARISES FREQUENTLY DUE TO LACK OF 
CONTROL OF STRUCTURE. Consistently high level of inaccuracy іп 
high-frequency features of morphology, syntax, and/or phonology, which 
causes the subject to have to repeat, rephrase, or even change what 
he/she wishes to say. Communication is limited and subject is 
perceived to be ineffective at using the structure of the language 
reliably. 


3. INTRUSIVE - INCONSISTENT ACCURACY IN RELATIVELY HIGH-FREQUENCY 
areas of syntax, morphology, and/or phonology distract the tester. 
Generally subject manages to encode his messages in a fashion which is 
comprehensible. Often, however, the tester must use the context, 
real-world referential knowledge, etc., in order to follow the 
subject's performance. The possibilities exist for confusion, and the 
tester must work actively at understanding the subject's performance. 


4. ACCEPTABLE - STRUCTURAL INACCURACY 1S RARELY THE MAJOR CAUSE OF 
MISUNDERSTANDINGS. Errors which do exist are not perceived to be 
major deficiencies in the contexts which have arisen during the course 
of the assessment, and the inference can be made that they should not 
prove to be impediments in naturally arising contexts. 


5. SUCCESSFUL - RANGE AND CONTROL OF THE STRUCTURE IS GREAT; control 
of even low-frequency features of structure give subject wide 
flexibility of expression; lack of control of low-frequency structural 
features rarely constitutes a reason for ambiguities or 
misunderstandings to arise. The tester is convinced that the subject 
can reliably use the structural features of the language to encode 
his/her communicative intent. 


6. SUPERIOR - STRUCTURAL ACCURACY AND FLEXIBILITY APPROACHES BILINGUAL 
COMPETENCE. While phonetically the speech may һе identifiably 
unusual, it is perceived to be an acceptable stylistic variant which 
is not meaning-altering. 
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LEXICALIZATION* 


1. BLOCKING - LEXICALIZATION INACCURATE AND VERY NARROW. Tester may 
not understand the meanings intended, or, when subject attempts 
extended discourse, cannot follow the gist of the performance. 


2. DYSFUNCTIONAL - LEXICALIZATION RANGE IS NARROW AND HIGHLY UNNATURAL 
FOR THE LANGUAGE. The tester is required to request the subject to 
rephrase utterances frequently; if the subject is unable to find 
better lexicalization, he/she may be forced to change the sense of his 
intended message іп order to accommodate lexical deficiencies. 
Mord-choice and phrasing may be heavily calqued, i.e. loan translated 
out of the subject's mother tongue (or some other language), thus 
the subject may string together items whose individual meanings are 
overridden by the “sum-of-the-parts" meaning of the utterance. 
Frequent occurrences of the above phenomena render the performance on 
this factor DYSFUNCTIONAL. 


3. INTRUSIVE - LEXICALIZATION IS UNUSUAL AND/OR IMPRECISE, although 
vocabulary may seem numerically extensive. Often, however, the tester 
must use the context, real-world knowledge, etc., in order to follow 
the subject's performance. The tester may be required to request 
rephrasing of utterances, but the subject IS CAPABLE of repairing the 


source of the difficulty. Frequently, the lexical choices within а 
given phrase, sentence, topic, etc., may appear to be drawn from 
different stylistic registers. Calqued (literally translated) 


phrases, "made-up words", misuse of idioms/metaphors/proverbs, etc. 
may be confusing and/or irritating to the native-speaking tester. The 
tester usually understands the subject well, but must sometimes rely 
on familiarity with the speech of learners of his/her language. 


4. ACCEPTABLE - LEXICALIZATION IS CLEAR, AND RELATIVELY NATURAL. 
Appropriate lexical choices are made in language-use tasks. Lack of 
breadth in vocabulary is well compensated for by clear periphrasis. 
The tester understands the intended meanings of the subject. 
Stylistic nuances may be rarely employed, but errors of register 
choice are rare. Idioms/metaphors/proverbs, etc. may be misused, but 
not frequently, and not so as to confuse or irritate the tester. 
Loan-translations are very infrequent and do not interfere with 
effective transmission of the subject's message. 


5. SUCCESSFUL - VERY INFREQUENT IMPRECISION OF LEXICALIZATION. Range 
of contexts in which appropriate lexical choices are made is wide and 
highly relevant to sophisticated, or formal  language-use skill 
requirements. Obscure, childhood, and specialized low-frequency 
vocabulary may be expected to be absent at this level. Idioms, humor, 
relatively accurate cultural reference, and subtleties of lexical 
distinctions between closely related concepts are evident and 
significantly enrich the overall performance of the subject. The 


FIn anguages in which there is an agreed on standard variety, it is 
often on the factor of LEXICALIZATION that deviation from the 
standard may be accounted for. 
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tester feels confident that the subject is conveying his/her 
communicative intent. 


6. SUPERIOR - LEXICALIZATION IS PRECISE. Not only can the subject 
encode concepts precisely, he/she can convey essentially any message 
appropriate to the context (social, situational, contentual). Lexical 
control is essentially that of an articulate well-informed native 
speaker. Stylistic nuances, such as control of near synonyms for 
attitudinal tone, effect, use of literate, even classical, vocabulary, 
and appropriate use of metaphor/proverb/idiom, as well as well-chosen 
cultural, historical, and/or literary reference characterize the 
overall performance. Іп languages where formal/elevated style exists, 
it may be evidence of the subject's ability to use that style 
effectively which gives maximum credit on this factor. 
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FLUENCY 


1. BLOCKING - SUBJECT SPEAKS WITH DIFFICULTY. Quantity of speech 15 
insufficient for even minimal communication. When speech does occur, 
pause time exceeds speaking time. 


2. DYSFUNCTIONAL - FLUENCY IS IRREGULAR, Continuity and quantity of 
speech is inadequate for communication beyond social interchange. 
When subject attempts to engage in more complex speech, he/she pauses 
frequently іп mid-utterance or between utterances. The subject 
frequently starts to say something which he/she cannot finish. Pauses 
are unfilled or not suitably filled. 


3. INTRUSIVE - SUBJECT SPEAKS READILY BUT NOT FLUENTLY. Continuity 
and quantity of speech seems to be adequate for а variety of 
communication tasks. However, hesitations, false starts, 


self-interruptions and self-corrections may abound. 


4. ACCEPTABLE - SUBJECT SPEAKS READILY, SUITABLY FELLING PAUSES. 
Continuity and quantity of speech is adequate for all but the most 
complex communication tasks. Long lapses in production, false starts 
and unintentionally incomplete sentences occur, but are self-repaired. 


5. SUCCESSFUL - PERFORMANCE 15 FLUENT. Quantity of speech is 
sufficient even for unusual speaking tasks. While there may be 
hesitations and self corrections, as well as some searching for words, 
this is not perceived as disruptive. 


6. SUPERIOR - THE FLOW OF SPEECH IS EFFORTLESS AND SMOOTH IN EVERY 
RESPECT. 
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THE SUMMER INSTITUTE OF LINGUISTICS 
LANGUAGE SKILL LEVEL DESCRIPTIONS 


PREFACE 


The following proficiency level descriptions characterize 
spoken language use. Each of the six "base levels" (coded 00, 10, 20, 
30, 40, and 50) implies control of any previous "base levels" 
functions and accuracy. The "plus level" designation (coded 06, 16, 
26, etc.) will be assigned when proficiency substantially exceeds one 
base skill level and does not fully meet the criteria for the next 
“base level". The "plus level" descriptions are therefore 
supplementary to the "base level" descriptions. 


А skill level is assigned to а person through ап authorized 
language assessment. Linguists assign a level on а variety of 
performance criteria exemplified іп the descriptive statements. 
Therefore, the examples given here illustrate, but do not exhaustively 
describe, either the skills a person may possess or situations in 
which he/she may function effectively. 


Statements describing accuracy refer to typical stages in the 
development of competence in the most commonly taught languages in 
formal training programs. In other languages, emerging competence 
parallels these characterizations, but often with different details. 


Unless otherwise specified the term "native speaker" refers to 
native speakers of а standard dialect. In the context of these 
proficiency descriptions, "well-educated" does not necessarily imply 
formal higher education. However, іп cultures where formal higher 
education is common, the  language-use abilities of persons who have 
had such education is considered the standard. That is, such a person 
meets contemporary expectations for the formal, careful style of the 
language, as well as a range of less formal varieties of the language. 


In situations where education does not necessarily define the best 
speakers of the target language, the standard used by any existing 
oral or written media, (e.g., newspapers, Scriptures, radio, 
television, etc.) should be reflected. If none of the above exist as 
an aid іп determining the standard variety of the target language, 
respected people іп the community should be consulted in order to 
ensure that the testers chosen control a representative variety of 
speech. 


*Adapted from the 1987 Interagency Language Roundtable Skill Level 
Descriptions by The Summer Institute of Linguistics and Dr. Thea C. 
Bruhn, Head, Language Testing Unit, U.S. Department of State for use 
in societies that include pre-literate communities. 
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SPEAKING 0 (NO PROFICIENCY) 


Unable to function in the spoken language. Oral production is 
limited to occasional isolated words. Has essentially no 
communicative ability. (Has been coded 5-0 іп some nonautomated 
applications.) (Data Code 00) 


SPEAKING 0+ (MEMORIZED PROFICIENCY) 


ABLE TO SATISFY IMMEDIATE NEEDS USING REHEARSED UTTERANCES. 
Shows little real autonomy of expression, flexibility, or spontaneity. 
Can ask questions or make statements with reasonable accuracy only 
with memorized utterances or formulae. Attempts at creating speech 
are usually unsuccessful. 

EXAMPLES: The individual's vocabulary is usually limited to areas 
of immediate survival needs. Most utterances are telegraphic; that 
is, functors (linking words, markers, and the Тіке) are omitted, 
confused, or distorted. An individual can usually differentiate most 
significant sounds when produced in isolation, but, when combined in 
words or groups of words, errors may be frequent. Even with 
repetition, communication is severely limited even with people used to 
dealing with foreigners. Stress, intonation, tone, etc. are usually 
quite faulty. {Has been coded 5-0+ іп some nonautomated 
applications.) (Data Code 06) 


SPEAKING 1 (ELEMENTARY PROFICIENCY) 


ABLE TO SATISFY MINIMUM COURTESY REQUIREMENTS AND MAINTAIN VERY 
SIMPLE FACE-TO-FACE CONVERSATIONS ON FAMILIAR TOPICS. A native 
speaker must often use slowed speech, repetition, paraphrase, or a 
combination of these to be understood by this individual. Similarly, 
the native speaker must strain and employ real-world knowledge to 
understand even simple statements/questions from this individual. 
This speaker has a functional, but limited proficiency. 
Misunderstandings are frequent, the individual is able to ask for help 
and to verify comprehension of native speech in face-to-face 
interaction. The individual is unable to produce continuous discourse 
except with rehearsed material. 

EXAMPLES: Structural accuracy is likely to be random or severely 
limited. Time concepts are vague. Vocabulary is inaccurate, and its 
range is very narrow. The individual often speaks with great 
difficulty. By repeating, such speakers can make themselves 
understood to native speakers who are in regular contact with 
foreigners but there is little precision in the information conveyed. 
Needs, experience, or training may vary greatly from individual to 
individual; for example, speakers at this level may have encountered 
quite different vocabulary areas. However, the individual can 
typically satisfy predictable, simple, personal and accommodation 
needs; can generally meet courtesy, introduction, and identification 
requirements; exchange greetings; elicit and provide, for example, 
predictable and skeletal biographical information. He/she might give 
information about business hours, explain routine procedures in a 
limited way, and state in a simple manner what actions will be taken. 
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He/she is able to formulate some questions even in languages with 
complicated question constructions. Almost every utterance may be 
characterized by structural errors and errors in basic grammatical 
relations. Vocabulary is extremely limited and characteristically 
does not include modifiers. Pronunciation, stress, and intonation are 
generally poor, often heavily influenced by another language. Use of 
structure and vocabulary is highly imprecise. (Has been coded 5-1 іп 
some nonautomated applications.) (Data Code 10) 


SPEAKING 1+ (ELEMENTARY PROFICIENCY, PLUS) 


CAN INITIATE AND MAINTAIN PREDICTABLE FACE-TO-FACE CONVERSATIONS 
AND SATISFY LIMITED SOCIAL DEMANDS. He/she may, however, have little 
understanding of the social conventions of conversation. The 
interlocutor is generally required to strain and employ real-world 
knowledge to understand even some simple speech. The speaker at this 
level may hesitate and may have to change subjects due to lack of 
language resources. Range and control of the language are limited. 
Speech largely consists of a series of short, discrete utterances. 

EXAMPLES: The individual is able to satisfy most travel and 
accommodation needs and a limited range of social demands beyond 
the exchange of skeletal biographic information. Speaking ability 
may extend beyond immediate survival needs. Accuracy in basic 
grammatical relations is evident, although not consistent. May 
exhibit the more common forms of verb tenses, for example, but 
may make frequent errors іп formation and selection. While 
some structures are established, errors occur in more complex 
patterns. The individual typically cannot sustain coherent 
structures in longer utterances or unfamiliar situations. Ability 
to describe and give precise information 15 limited. Person, 
space, and time references are often used incorrectly. Pronunciation 
is understandable to natives used to dealing with foreigners. Can 
combine most significant sounds with reasonable comprehensibility, 
but has difficulty in producing certain sounds in certain positions 
or in certain combinations. Speech will usually be labored, 
Frequently has to repeat utterances to be understood by the 
general public. (Has been coded S-1+ іп some nonautomated 
applications.) (Data Code 16) 


SPEAKING 2 (LIMITED PROFICIENCY) 


ABLE TO SATISFY ROUTINE SOCIAL DEMANDS AND LIMITED REQUIREMENTS 
IN OTHER DOMAINS. Can handle routine work-related interactions that 
are limited іп scope. In more complex and sophisticated language 
tasks, language usage generally disturbs the native speaker. Can 
handle with confidence, but not with facility, most normal, 
high-frequency social conversational situations including extensive, 
but casual conversations about current events, as well as work, 
family, and autobiographical information. The individual can get 
the gist of most everyday conversations but has some 
difficulty understanding native speaker in situations that require 
specialized or sophisticated knowledge. The individual's utterances 
are minimally cohesive. Linguistic Structure is usually not very 
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elaborate and not thoroughly controlled; errors are frequent. 
Vocabulary use is appropriate for high-frequency utterances, but 
unusual or imprecise elsewhere, 

EXAMPLES: While these interactions will vary widely from 
individual to individual, the individual can typically ask and answer 
predictable questions in familiar domains and can give апа 
understand straightforward instructions to subordinates. 
Additionally, the individual сап participate in personal and 
accommodation-type interactions with elaboration and facility; 
that is, can give and understand complicated, detailed, and 
extensive directions and make non-routine changes in travel and 
accommodation arrangements. Simple structures and basic grammatical 
relations are typically controlled; however, there are areas of 
weakness. In the commonly taught languages, these may be simple 
markings such as plurals, articles, linking words, and negatives or 
more complex structures such as tense/aspect usage, case morphology, 
passive constructions, word order, and embedding. (Has been coded 
5-2 in some nonautomated applications.) (Data Code 20) 


SPEAKING 2+ (LIMITED PROFICIENCY, PLUS) 


ABLE TO SATISFY MOST REQUIREMENTS WITH LANGUAGE USAGE THAT IS 
OFTEN, BUT NOT ALWAYS, ACCEPTABLE AND EFFECTIVE. The individual shows 
considerable ability to communicate effectively on topics relating to 
particular interests and special fields of competence. Often shows a 
high degree of fluency and ease of speech, yet when under tension or 
pressure, the ability to use the language effectively may deteriorate. 
Comprehension of normal native speech is typically nearly complete. 
The individual may miss cultural and local references and may require 
a native speaker to adjust to his/her limitations in some ways. 
Native speakers often perceive the individual's speech to contain 
awkward or inaccurate phrasing of ideas, mistaken time, space, and 
person references, or to be in some way inappropriate, if not strictly 
incorrect, 

EXAMPLES: Typically the individual can participate in most 
social, formal, апа informal interaction; but limitations either in 
range of contexts, types of tasks, оғ level of accuracy hinder 
effectiveness. Тһе individual тау be 111 at ease with the use of the 
language either in social interaction or іп speaking at length іп 
occupational contexts. He/she is generally strong іп either 
structural precision or vocabulary, but not іп both. Weakness or 
unevenness in опе of the foregoing, or in pronunciation, occasionally 
results іп miscommunication. Normally controls, but cannot always 
easily produce general vocabulary. Discourse is often incohesive. 


(Has been coded 5-2% in some nonautomated applications.) (Data Code 
26) 


SPEAKING 3 (GENERAL PROFICIENCY) 


ABLE TO SPEAK THE LANGUAGE WITH SUFFICIENT STRUCTURAL ACCURACY 
AND VOCABULARY TO PARTICIPATE EFFECTIVELY IN MOST FORMAL AND INFORMAL 
CONVERSATIONS ON PRACTICAL, SOCIAL AND OCCUPATIONAL TOPICS. 
Nevertheless, the individual's limitations generally restrict the 
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special interest contexts оҒ language use to shared knowledge and 


behavior understood cross-culturally. Discourse is cohesive. The 
individual uses the language acceptably, but with some noticeable 
imperfections; yet, errors virtually never interfere with 


understanding and rarely disturb the native speaker. The individual 
can effectively combine structure and vocabulary to convey his/her 
meaning accurately. The individual speaks readily and fills pauses 
suitably. Іп face-to-face conversation with mother-tongue speakers 
of the standard dialect at а normal rate of speech, comprehension 
is quite complete. Although cultural references, proverbs, 
and the implications of nuances and idiom may not be fully 
understood, the individual can easily repair the conversation. 
Pronunciation may be obviously foreign. Individual sounds are 
accurate; but stress, intonation, and pitch control may be faulty. 
EXAMPLES: Сап typically discuss particular interests and special 
fields of competence with reasonable ease. Can use the language, for 
example, in any of several domains іп order to answer objections, 
clarify points, justify decisions, understand the essence of 
challenges, state and defend accepted ways of doing business, conduct 
meetings, convey information, or other extended and elaborate 
informative monologues. Can reliably elicit information and informed 


opinion from native speakers. Structural  inaccuracy is rarely the 
major cause of misunderstanding. Use of structural devices 15 
flexible and elaborate. Without searching for words or phrases, the 


individual uses the language clearly and relatively naturally to 
elaborate concepts freely and make ideas easily understandable to 
native speakers. Errors occur in low-frequency and highly complex 
structures. (Has been coded 5-3 in some nonautomated applications.) 
(Data Code 30) 


SPEAKING 3+ (GENERAL PROFICIENCY PLUS) 


IS OFTEN ABLE TO USE THE LANGUAGE TO SATISFY NEEDS IN A WIDE 
RANGE OF SOPHISTICATED AND DEMANDING TASKS. 

EXAMPLES: Despite obvious strengths, may exhibit some hesitancy, 
uncertainty, effort, or errors which limit the range of language-use 
tasks that can be reliably performed. Typically there is particular 
strength in fluency and one or more, but not all, of the following: 
breadth of lexicon, including low- and medium-frequency items, 
especially sociolinguistic and cultural references, and nuances of 
close synonyms; structural precision, with sophisticated features 
that аге readily, accurately, and appropriately controlled (such 
as complex modification and embedding іп Indo-European languages); 
discourse competence in a wide range of contexts and tasks, often 
matching а native speaker's strategic and organizational 
abilities and expectations. Occasional patterned errors occur in 
low frequency and highly-complex structures. (Has been coded 5-3% in 
some nonautomated applications.) (Data Code 38) 


SPEAKING 4 (ADVANCED PROFICIENCY) 


ABLE TO USE THE LANGUAGE FLUENTLY AND ACCURATELY ON ALL LEVELS 
NORMALLY PERTINENT TO NEEDS. The individual's language usage and 


% 
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ability to function are fully successful. Organizes discourse well, 
using appropriate rhetorical speech devices, native cultural 
references, and understanding. Language ability only rarely hinders 
him/her in performing any task requiring language; yet, the individua 
would seldom be perceived as а native. Speaks effortlessly and 
smoothly and 45 able to use the language with а high degree of 
effectiveness, reliability, and precision for all representational 
purposes within the range of personal and occupation related 
experience and scope of responsibilities. Сап serve as an informal 
interpreter in a range of unpredictable circumstances. Can perform 
extensive, sophisticated language tasks, encompassing most matters of 
interest to "well-educated" native speakers, including tasks which do 
not bear directly on any occupational specialty. 

EXAMPLES: Can discuss in detail concepts which are fundamentally 
different from those of the target culture and make those concepts 
clear and accessible to the native speaker. Similarly, the individual 
can understand the details and ramifications of concepts that are 
culturally or conceptually different from his/her own. Can set the 
tone of interpersonal verbal exchanges with a representative range of 
high and low status native speakers іп a variety of audiences, 
tasks, and settings and with a variety of purposes. Can play an 
effective role among native speakers іп such domains as the home, 
courts and government, religion, education, and debates on matters of 
disagreement. Can advocate a position at length, both formally and in 
chance encounters, using sophisticated verbal strategies. Understands 
and reliably produces shifts of both subject matter and tone. Can 
understand native speakers of the standard and other major dialects in 
essentially any face-to-face interaction. (Has been coded 5-4 in some 
nonautomated applications.) (data Code 40) 


SPEAKING 4% (ADVANCED PROFICIENCY, PLUS) 


SPEAKING PROFICIENCY IS REGULARLY SUPERIOR IN ALL RESPECTS 
USUALLY EQUIVALENT TO THAT OF A “WELL-EDUCATED", HIGHLY ARTICULATE 
NATIVE SPEAKER. Language ability does not impede the performance of 
any language-use task. However, the individual would not necessarily 
be perceived as culturally native. 

EXAMPLES: The individual organizes discourse well, employing 
functional rhetorical speech devices, native cultural references and 
understanding. Effectively applies a mative speaker's social and 
circumstantial knowledge. However, cannot sustain that performance 
under а11 circumstances. While the individual has a wide range and 
control of structure, an occasional non-native slip may occur. The 
individual has a sophisticated control of vocabulary and phrasing that 
is rarely imprecise, yet there are occasional weaknesses in idiams, 
colloquialisms, pronunciation, cultural reference or there may be an 
occasional failure to interact іп a totally native manner. (Has been 
coded 5-4% in some nonautomated applications.) (Data Code 46) 


SPEAKING 5 (FUNCTIONALLY NATIVE PROFICIENCY) 


SPEAKING PROFICIENCY 15 FUNCTIONALLY EQUIVALENT ТО THAT OF A 
HIGHLY ARTICULATE WELL-EDUCATED NATIVE SPEAKER AND REFLECTS THE 


L^ 
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CULTURAL STANDARDS ОҒ THE COUNTRY WHERE THE LANGUAGE IS NATIVELY 
SPOKEN. The individual uses the language with complete flexibility 
and intuition, so that speech on ail levels is fully accepted by 
"well-educated" native speakers in all of its features, including 
breadth of vocabulary and idiom, colloquialisms, and pertinent 
cultural references. Pronunciation is typically consistent with that 
of "well-educated" native speakers of a non-stigmatized dialect. (Has 
been coded S-5 in some nonautomated applications.) (Data Code 50) 


SECOND LANGUAGE ORAL PROFICIENCY EVALUATION 
SCORING FORM 
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JUSE'S MOTHER TONGUE: SPOUSE^S OTHER TONGUES: 

3CES TRAVELLED: DEGREE OF CONTACT WITH L2: 

H i LINGUIST: ASSISTANT : 
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